Image pickup terminal

ABSTRACT

An image pickup terminal includes an image pickup section, a data storage section which stores shutter sound setup data that sets a shutter sound generating when the image pickup section performs an imaging, a shutter sound generating section which generates a shutter sound based on the shutter sound setup data stored in the data storage section, a shutter sound appropriateness checking section which determines whether a shutter sound based on the shutter sound setup data stored in the data storage section is appropriate or not, and a control section which inhibits data setting of a shutter sound determined as being inappropriate by the shutter sound appropriateness checking section.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional of application Ser. No. 11/318,094filed Dec. 23, 2005, the entire contents of which are incorporatedherein by reference. Also this application is based upon and claimsbenefit of priority under 35 U.S.C.

119 from the prior Japanese Patent Applications No. 2004-377867 filed onDec. 27, 2004, and No. 2004-377868 filed on Dec. 27, 2004, the entirecontents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image pickup terminal, such as acellular phone equipped with a camera, which enables to install, set orrewrite an application for setting shutter sounds or shutter sound data.

2. Description of the Related Art

Recently, there has been a surge in the popularity of camera equippedportable terminals, e.g., cellular phones having internally mountedimage pickup devices, including digital cameras, and the use of portableterminal mounted cameras for surreptitious photography practices hasspread and has become a social problem.

Thus, to resolve this problem, it is common for a cellular phone havingan internally mounted camera to provide aural notification within asurrounding area of imaging in that vicinity, by emitting anappropriately high volume sound when the shutter of the camera isgenerated, regardless of the setting of a manner mode, for example. Thisis also a designated carrier specification for cellular phones.

Further, data for a shutter release sound for imaging is selectable at asetup stage. But at the present, the shutter sound choices are fixed, sothat presently, only predesignated sound data can be selected by a user.

Therefore, regardless of which sound data a user selects, a shuttersound having a satisfactory volume is always emitted when an image ispicked up, so that notification can be provided for a surrounding areathat the user is imaging in that vicinity.

The use has also spread of portable terminals mounting platforms such asBREW, iαappli, Vappli, Microsoft Smartphone, Linux and Symbian thatpermit users, in accordance with their tastes, to install variousadditional application software products.

Thus, additional application software for controlling the camerafunction can be used in accordance with the judgements of the users.

As example apparatuses constituted so as to release a shutter sound atthe time an image is picked up, the following first to seventhapparatuses have been proposed.

The first apparatus is an image pickup terminal, such as an electronicstill camera that normally releases a mechanical shutter sound that isnot, or is only faintly, audible, for which sound is used to output animaging start and end time that enables a user to apprehend the shuttertime by intuition (see, for example, JP-A-2003-338956).

The second apparatus is a cellular phone that can use, as a shuttersound, sound data obtained from a server via a network.

The third apparatus is a recording/reproduction apparatus that canrewrite, using a memory card, a camera control program that includesdata for a shutter sound.

The fourth apparatus is a digital camera that can download shutter sounddata from a server and change the setup.

The fifth apparatus is a portable terminal that can download anaccessory application from a network.

The sixth apparatus is a system that supports, by remote control, anelectronic device, such as a digital camera, and provides a digitalcamera diagnosis application via a network.

The seventh apparatus is a cellular phone that can provide applications,for example, via a network.

JP-A-2003-338956 is referred to as a related art.

It is predicted that the above described sound data for shutter soundswill probably be available to users via the Internet, or an externaldevice, for employment as added sound choices.

In this case, the possibility exists that a user will choose to selectand set sound data that are inappropriate for the intended purpose ofproviding notification within a surrounding area that the user isimaging in that vicinity.

Furthermore, a camera-mounted portable terminal, on which one of theabove described platforms is mounted, may be employed by additionallyinstalling camera application software that does not emit a shuttersound during an imaging process, or that can be used for a setup toprevent the emission of a shutter sound.

SUMMARY OF THE INVENTION

An object of the invention is to provide an image pickup terminal thatgenerates a shutter sound having an adequately high volume whenever animaging is performed, so that it can provide notification in an imagedarea, and it can inhibit a picked-up image data from being abused.

The invention provides an image pickup terminal, having: an image pickupsection; a data storage section which stores shutter sound setup datathat sets a shutter sound generating when the image pickup sectionperforms an imaging; a shutter sound appropriateness checking sectionwhich performs a shutter sound appropriateness check to determinewhether a shutter sound based on the shutter sound setup data stored inthe data storage section is appropriate or not; and a control sectionwhich inhibits a setting of a shutter sound checked as beinginappropriate by the shutter sound appropriateness checking section.

The invention also provides an image pickup terminal, having: an imagepickup section; a data storage section which stores shutter sound setupdata that sets a shutter sound generating when the image pickup sectionperforms an imaging; a shutter sound appropriateness checking sectionwhich checks whether a shutter sound based on the shutter sound setupdata stored in the data storage section is appropriate or not; and acontrol section which rewrites the shutter sound setup data to generatean appropriate shutter sound when the shutter sound appropriatenesschecking section checks the shutter sound data stored in the datastorage section as being inappropriate.

The invention also provides an image pickup terminal having: an imagepickup section; a data storage section which stores shutter sound setupdata that sets a shutter sound generating when the image pickup sectionperforms an imaging; a shutter sound generating section which generatesa shutter sound based on the shutter sound setup data stored in the datastorage section; an image pickup driver which controls the image pickupsection; a shutter sound driver which controls the shutter soundgenerating section; and a control section which does instruct theshutter sound driver so that the shutter sound generating sectiongenerates a shutter sound based on the shutter sound setup data storedin the data storage section when the image pickup driver receives animaging instruction.

In the image pickup terminal, the shutter sound appropriateness checkingsection checks an appropriateness of a new shutter sound before theshutter sound setup data stored in the data storage section isrewritten, and the control section rewrites the shutter sound setup datastored in the data storage section, when the shutter soundappropriateness checking section determines as being appropriate, andthe control section does not rewrite the shutter sound setup data storedin the data storage section, when the shutter sound appropriatenesschecking section determines as being inappropriate.

In the image pickup terminal, the shutter sound appropriateness checkingsection performs the shutter sound appropriateness check when an imaginginstruction is issued, and the image pickup section performs an imaging,when the shutter sound appropriateness checking section determines asbeing appropriate, and the image pickup section performs an imagingafter a basic shutter sound data is set, when the shutter soundappropriateness checking section determines as being inappropriate.

In the image pickup terminal, the shutter sound appropriateness checkingsection performs the shutter sound appropriateness check when a shuttersound generating instruction is issued, and the shutter sound generatingsection generates the shutter sound based on the shutter sound setupdata stored in the data storage section, when the shutter soundappropriateness checking section determines as being appropriate, andthe shutter sound generating section generates a basic shutter soundafter a basic shutter sound data is set in the data storage section,when the shutter sound appropriateness checking section determines asbeing inappropriate.

According to the image pickup terminal, when an image is picked up, ashutter sound having an adequately high volume is always generated, sothat notification is provided in an imaging area.

The invention also provides an image pickup terminal, having: an imagepickup section; a data storage section which stores shutter sound setupdata that sets a shutter sound generating when the image pickup sectionperforms an imaging; a shutter sound generating section which generatesa shutter sound based on the shutter sound setup data stored in the datastorage section; a shutter sound appropriateness checking section whichchecks whether a shutter sound based on the shutter sound setup datastored in the data storage section is appropriate or not; and a controlsection which controls the shutter sound generating section to generatethe shutter sound based on the shutter sound setup data stored in thedata storage section when the image pickup section performs an imaging,wherein, when a shutter sound generated from the shutter soundgenerating section is inappropriate, the control section controls theshutter sound generating section to generate an appropriate shuttersound subsequently.

The invention also provides an image pickup terminal having: an imagepickup section; a data storage section which stores shutter sound setupdata that sets a shutter sound generating when the image pickup sectionperforms an imaging; a shutter sound generating section which generatesa shutter sound based on the shutter sound setup data stored in the datastorage section; an image pickup driver which controls the imagesection; a shutter sound driver which controls the shutter soundgenerating section; and a control section which does instruct theshutter sound driver so that the shutter sound generating sectiongenerates a shutter sound based on the shutter sound setup data storedin the data storage section when the image pickup driver receives animaging instruction.

In the image pickup terminal, the shutter sound appropriateness checkingsection determines a shutter sound as being appropriate when the shuttersound generates in predetermined volume or higher for a predeterminedperiod of time or more within a specific period of time following theimaging start.

In the image pickup terminal, the data storage section includes: ashutter sound setup data storage section which stores the shutter soundsetup data; and a basic shutter sound data storage section which storesa basic shutter sound, wherein the shutter sound generator generates ashutter sound based on the basic shutter sound data stored in the basicshutter sound data storage section, when the shutter soundappropriateness checking section determines as being inappropriate.

The invention also provides an image pickup terminal, having: an imagepickup section; a data storage section which stores shutter sound setupdata that sets a shutter sound generating when the image pickup sectionperforms an imaging; a shutter sound generating section which generatesa shutter sound based on the shutter sound setup data stored in the datastorage section; a shutter sound appropriateness checking section whichchecks whether a shutter sound based on the shutter sound setup datastored in the data storage section is appropriate or not; a storagesection which temporarily stores image data of an image picked up by theimage pickup section; and a control section which controls the shuttersound generating section to generate the shutter sound based on theshutter sound setup data stored in the data storage section when theimage pickup section performs an imaging, wherein the control sectioninhibits the image data stored in the storage section from being readwhen a shutter sound generated from the shutter sound generating sectionis inappropriate.

In the image pickup terminal, the control section deletes the image datastored in the storage section when the shutter sound generated from theshutter sound generating section is inappropriate.

In the image pickup terminal, the shutter sound appropriateness checkingsection includes, at the least either a section which detects volume ofa shutter sound generated from the shutter sound generating section withusing a microphone, or a section which detects amplitude of a digitalsignal or an analog signal related to the shutter sound generated fromthe shutter sound generating section.

In the image pickup terminal, the shutter sound appropriateness checkingsection determines a shutter sound as being appropriate when the shuttersound generates in predetermined volume or higher for a predeterminedperiod of time or more within a specific period of time following theimaging start.

According to the image pickup terminal, when an image is picked up, ashutter sound having an adequately high volume is always generated, sothat a picked-up image data obtained by imaging is inhibited from beingabused because illegal use of image data obtained by imaging can beprevented.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing the configuration of a cellular phone thatemploys an image pickup terminal according to a first embodiment of thepresent invention;

FIG. 2 is a graph showing an example waveform for a case wherein ashutter sound was generated by a sounder at an adequately high volume;

FIG. 3 is a graph showing an example first waveform for a case wherein ashutter sound was not generated by the sounder at an adequately highvolume;

FIG. 4 is a graph showing an example second waveform for a case whereina shutter sound was generated too late by the sounder, but at anadequately high volume;

FIG. 5 is a graph showing an example third waveform for a case wherein ashutter sound was too short, but was generated by the sounder at anadequately high volume;

FIG. 6 is a diagram for explaining a first operation performed by theimage pickup terminal shown in FIG. 1;

FIG. 7 is a diagram for explaining a second operation performed by theimage pickup terminal shown in FIG. 1;

FIG. 8 is a diagram for explaining a third operation performed by theimage pickup terminal shown in FIG. 1;

FIG. 9 is a diagram showing the configuration of a cellular phone thatemploys an image pickup terminal according to a second embodiment of thepresent invention;

FIG. 10 is a graph showing an example waveform for a case wherein ashutter sound was generated by a sounder at an adequately high volume;

FIGS. 11A and 11B are graphs showing example waveforms for cases whereina shutter sound was not generated by the sounder at an adequately highvolume;

FIG. 12 is a graph showing an example waveform for a case whereinbecause a shutter sound was not generated by the sounder at anadequately high volume, a basic shutter sound was therefore alsogenerated;

FIG. 13 is a diagram for explaining the operation of the image pickupterminal shown in FIG. 9;

FIG. 14 is a diagram showing the configuration of a cellular phone thatemploys an image pickup terminal according to a third embodiment of thepresent invention; and

FIG. 15 is diagram for explaining the operation of the image pickupterminal shown in FIG. 14.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present invention will now be described whilereferring to the drawings.

First Embodiment

FIG. 1 is a diagram showing the configuration of a cellular phone thatemploys an image pickup terminal according to a first embodiment of theinvention.

As shown in FIG. 1, a cellular phone 110 includes a radio communicationsection 111, an image pickup section (a camera) 112, a notificationsection (a sounder) 113, a memory 114, a display section 115, a soundoutput section 116, a sound input section 117, a key operating section118, a clock/timer 119, and a controller 120.

In FIG. 1, reference numeral 130 denotes a radio base station, andreference numeral 131 denotes a communication network.

In order to communicate using radio waves, the radio communicationsection 111 modulates various information, such as image data, soundinformation and electronic mail processed by the controller 120, andtransmits these data, via a transmission/reception antenna (not shown),to the communication network 131 that includes the radio base station130.

Further, the radio communication section 111 receives, via thetransmission/reception antenna (not shown), a variety of information,such as image data, sound information and electronic mail that istransmitted by a server (not shown) across the communication network131, demodulates all received data, and transmits the demodulated datato the controller 120.

The image pickup section (a camera) 112 includes an optical systemincluding an object lens for obtaining an image of an object, and animage pickup processing circuit including an image pickup element forconverting the image of the object obtained by the optical system intoan electric signal. When an imaging key arranged on the key operatingsection 118 is manipulated, the optical image of the object is picked upby the optical system.

The image pickup processing circuit converts, into an electric signal,the optical image of the object formed by the optical system.

Specifically, in the image pickup processing circuit, the image of theobject is received by multiple light-receiving elements that arearranged, as pixel sections, on the two-dimensional plane of the imagepickup element. At this time, color information is obtained through thecolor filters of the light-receiving elements, whereby it is separatedinto data for the three primary colors (R, G and B).

The image pickup processing circuit converts the luminance levels of theindividual pixels into voltages, and an analog/digital (A/D) convertersequentially converts the voltages into digital data that it transmitsto the controller 120.

A CCD or a CMOS sensor, for example, is employed as the image pickupelement.

In accordance with an instruction issued by the controller 120, thenotification section (the sounder) 113 generates a shutter sound inaccordance with the shutter sound setup data or the basic shutter sounddata.

The notification section (the sounder) 113 is constituted, for example,by a sounder or a vibrator.

The memory 114, which is accessed by the controller 120, includes ashutter sound setup data storage section 1141 for storing shutter soundsetup data that can be set by an application that sets a shutter soundor in accordance with data for a shutter sound, and a basic shuttersound data storage section 1142 for storing basic shutter sound dataprepared as data for default shutter sound data.

The memory 114 also includes a nonvolatile memory, an EEPROM, in whichimage data obtained and compressed by the image pickup section (thecamera) 112 are stored.

The display section 115 includes a display device, such as a liquidcrystal display device controlled by the controller 120, and displaystelephone numbers, a variety of messages and text data entered toperform a communication function.

The display section 115 also displays the image of an object obtained bythe image pickup section (camera) 112.

The sound output section 116 performs predetermined processing for soundinformation received from the controller 120, and outputs sound at aloudspeaker.

The sound input section 117 performs predetermined processing for soundcollected using a microphone, and transmits the obtained soundinformation to the controller 120.

The key operating section 118 includes an end (end communication)/powerkey, a start (call) key, ten key pad, for corresponding numbers, and animaging key, and when these keys are manipulated by a user, informationentered by the user is transmitted to the controller 120.

The controller 120, constituted mainly by a micro computer, controls theentire cellular phone 110 that serves as an image pickup terminal.

The controller 120 provides, for example, control of the radiotransmission/reception of a variety of information by the radiocommunication section 111, of the processing of sound information forthe sound output section 116 and the sound input section 117, of thedisplay of information on the display section 115, of the processingperformed in consonance with information entered at the key operatingsection 118, and of access relative to the memory 114.

The controller 120 has a function for employing the determinationobtained by a shutter sound appropriateness checking function 1204 toinhibit the setup of shutter sound setup data based on an applicationthat sets a shutter sound or data for a shutter sound.

The controller 120 includes a sounder (a shutter sound) driver 1201 forcontrolling the sounder 113, a camera (photography) driver 1202, acamera (photography) application 1203 for issuing an instruction to thecamera driver 1202 and the sounder (the shutter sound) driver 1201, anda forcible shutter sound generation application for detecting whetherthe camera (photography) application 1203 has issued an imaginginstruction to the camera driver 1202 and for issuing a shutter soundinstruction to the sounder (the shutter sound) driver 1201.

The controller 120 also includes the shutter sound appropriatenesschecking function 1204 for performing one of the following processes torelease an appropriate shutter sound and provide notification for asurrounding area of imaging in that vicinity.

Process 1: Before the shutter sound setup data stored in the shuttersound data storage section 1141 is rewritten, the appropriateness ofsound data is examined by the shutter sound appropriateness checkingfunction 1204. When it is determined that the sound data are notappropriate, rewriting of the shutter sound data storage section 1141 isdisabled and an appropriate setup for a shutter sound is maintained.

Process 2: Immediately before the imaging process is performed, theappropriateness of the setup data in the shutter sound setup datastorage section 1141 is examined by the shutter sound appropriatenesschecking function 1204. When it is determined that the setup data arenot appropriate, the basic shutter sound data in the basic shutter sounddata storage section 1142 in the memory 114 is set in the shutter soundsetup data storage section 1141, and imaging is initiated.

More specifically, when the rewriting of the shutter sound setup data inthe shutter sound setup data storage section 1141 is requested, thecontroller 120 employs the shutter sound appropriateness checkingfunction 1204 to examine the appropriateness of new sound data for ashutter sound that is to be set. When the controller 120 determines thatthe new sound data are appropriate, the controller 120 rewrites the datain the shutter sound setup data storage section 1141. When, however, thecontroller 120 determines that the sound data are not appropriate, thecontroller 120 does not rewrite the data.

Further, when an imaging instruction is issued to the camera driver1202, the controller 120 employs the shutter sound appropriatenesschecking function 1204 to examine for appropriateness sound data, for ashutter sound, that currently are set in the shutter sound data setupstorage section 1141. When the controller 120 determines that thecurrent sound data are appropriate, the imaging process is initiated.When, however, the controller 120 determines that the current sound dataare not appropriate, the current setup data in the shutter sound setupstorage section 1141 are overwritten with the basic shutter sound data,and the imaging process is initiated.

When a shutter sound release instruction is issued to the sounder driver1201, the controller 120 employs the shutter sound appropriatenesschecking function 1204 to examine for appropriateness sound data, for ashutter sound, that are currently set in the shutter sound setup datastorage section 1141. When the controller 120 determines that thecurrent sound data are appropriate, a set shutter sound is generated.When, however, the controller 120 determines that the current sound dataare not appropriate, the setup data in the shutter sound setup datastorage section 1141 are overwritten with to the basic shutter sounddata, and a shutter sound is generated.

When an imaging instruction is issued to the camera driver 1202, thecontroller 120 permits the camera driver 1202 to issue a shutter soundrelease instruction to the sounder driver 1201.

Then, the controller 120 accesses the memory 114 to read the shuttersound setup data, and outputs this data to the sounder 113.

In this embodiment, the shutter sound appropriateness checking function1204 employs the following determination references as examples.

When a sound has a frequency falling within the audible range, and whengenerated has a volume of 65 dB or higher and is emitted for 0.2 secondsor longer within a 0.5 second period following the start of monitoring(imaging), the sound is determined to be “appropriate”.

FIG. 2 is a graph showing an example waveform for a case wherein ashutter sound was generated by the sounder at an adequately high volume.

FIG. 3 is a graph showing a first example waveform for a case wherein ashutter sound was not generated by the sounder at an adequately highvolume.

In the example in FIG. 3, a volume of 65 dB or higher did not appearwithin 0.5 seconds of the start of monitoring (imaging).

FIG. 4 is a graph showing a second example waveform for a case wherein ashutter sound was generated late by the sounder.

In the example in FIG. 4, a sound was not generated at a volume of 65 dBor higher for 0.2 seconds or longer until after 0.5 seconds had elapsedfollowing the start of monitoring (imaging).

FIG. 5 is a graph showing a third example waveform for a case whereinthe time that a shutter sound was generated by the sounder wasinadequate.

In the example in FIG. 5, before 0.5 seconds had elapsed since the startof monitoring (imaging), the sound was generated at a volume of 65 dB orhigher for less than 0.2 seconds.

First, second and third operation patterns for the cellular phone 110shown in FIG. 1 will now be described in association with FIGS. 6, 7 and8.

The first operation pattern will be described in association with FIG.6.

When the imaging key of the key operating section 118 of the cellularphone 110 in FIG. 1 is manipulated (ST11) and an imaging instruction istransmitted to the camera driver 1202 via the camera application 1203 ofthe controller 120 (ST12), the camera driver 1202 issues a shutter soundrelease instruction to the sounder driver 1201 (ST13).

The shutter sound appropriateness checking function 1204 is employed,concurrently, to examine the appropriateness of new sound data for a setshutter sound. And when it is determined that the new sound data areappropriate, rewriting of the data in the shutter sound setup datastorage section 1141 is permitted and performed when, however, it isdetermined that the new sound data are not appropriate, rewriting usingthat data is neither permitted nor performed, and the sounder driver1201 obtains other shutter sound data (ST14).

The camera driver 1202 performs the imaging processing for the camera(the image pickup section) 112 (ST5).

Further, since it has previously been determined, through checkingperformed by the shutter sound appropriateness checking function 1204,that appropriate shutter sound setup data are available in storage, thesounder driver 1201 can always execute the sound release control for thesounder 113 in accordance with appropriate shutter sound data (ST16).

The second operation pattern will now be explained in association withFIG. 7.

When the imaging key of the key operating section 118 of the cellularphone 110 in FIG. 1 is manipulated (ST111) and an imaging instruction istransmitted to the camera driver 1202 through the camera application1203 of the controller 120 (ST112), a shutter sound appropriatenesschecking instruction is issued by the camera driver 1202 to the soundersound appropriateness checking function 1204 (ST113).

Upon receiving this instruction, the shutter sound appropriatenesschecking function 1204 examines for appropriateness sound data for ashutter sound that are currently set in the shutter sound setup datastorage section 1141. When it is determined that the current sound dataare appropriate, imaging is initiated. When, however, it is determinedthat the current sound data are not appropriate, the data in the shuttersound setup storage section 1141 are overwritten with basic shuttersound data (ST114).

A checking completion notification is transmitted by the shutter soundappropriateness checking function 1204 to the camera driver 1202(ST115), and then, a shutter sound release instruction is issued by thecamera driver 1202 to the sounder driver 1201 (ST116).

Also, shutter sound data are obtained by the sounder driver 1201(ST117).

Thereafter, the camera driver 1202 executes the imaging control for thecamera (image pickup section) 112 (ST118).

Further, the Sounder Driver 1201 Executes the Sound release control forthe sounder 113 in accordance with shutter sound setup data (ST119).

The third operation pattern will now be explained in association withFIG. 8.

When the imaging key of the key operating section 118 of the cellularphone 110 in FIG. 1 is manipulated (ST121) and an imaging instruction istransmitted to the camera driver 1202 via the camera application 1203 ofthe controller 120 (ST122), a shutter sound release instruction isissued by the camera driver 1202 to the sounder driver 1201 (ST123).

Then, a shutter sound appropriateness checking instruction is issued bythe sounder driver 1201 to the shutter sound appropriateness checkingfunction 1204 (ST124).

Upon receiving this instruction, the shutter sound appropriatenesschecking function 1204 examines for appropriateness current sound datafor a shutter sound that is set in the shutter sound setup data storagesection 1141. When it is determined that the current sound data areappropriate, a shutter sound is generated. When, however, it isdetermined that the current sound data are not appropriate, the sounddata currently set in the shutter sound setup data storage section 1141are overwritten with basic shutter sound data (ST125).

Following this, a checking completion notification is transmitted by theshutter sound appropriateness checking function 1204 to the sounderdriver 1201 (ST126), and the shutter sound data are obtained by thesounder driver 1201 (ST127).

Thereafter, the camera driver 1202 executes the imaging control for thecamera (image pickup section) 112 (ST128).

Further, the sound driver 1201 executes the sound release control forthe sounder 113 in accordance with the shutter sound setup data (ST129).

According to the embodiment, the cellular phone 110 includes the memory114 which is used to store shutter sound setup data that can be set inaccordance with an application for setting a shutter sound or shuttersound data, the notification section (the sounder) 113 which generates ashutter sound based on the shutter sound setup data stored in the memory114, and the controller 120 which has the shutter sound appropriatenesschecking function 1204 for determining whether a shutter sound generatedbased on shutter sound data is in a predetermined volume or higher, andwhich employs the determination obtained by the shutter soundappropriateness checking function 1204 to inhibit the shutter soundsetup data from being set. With this configuration, when an image ispicked up, a shutter sound having an adequately high volume is alwaysgenerated, so that notification can be provided in an imaging area.

Second Embodiment

FIG. 9 is a diagram showing the configuration of a cellular phone thatemploys an image pickup terminal according to a second embodiment of theinvention.

As shown in FIG. 9, a cellular phone 210 includes a radio communicationsection 211, an image pickup section (a camera) 212, a notificationsection (a sounder) 213, a sounder monitoring section 214, a memory 215,a display section 216, a sound output section 217, a sound input section218, a key operating section 219, a controller 220, and a clock/timer221.

In FIG. 9, reference numeral 230 denotes a radio base station, andreference numeral 231 denotes a communication network.

In order to communicate using radio waves, the radio communicationsection 211 modulates various information, such as image data, soundinformation and electronic mail processed by the controller 220, andtransmits these data, via a transmission/reception antenna (not shown),to the communication network 231 that includes the radio base station230.

Further, the radio communication section 211 receives, via thetransmission/reception antenna (not shown), a variety of information,such as image data, sound information and electronic mail that istransmitted by a server (not shown) across the communication network231, demodulates all received data, and transmits the demodulated datato the controller 220.

The image pickup section (a camera) 212 includes an optical systemincluding an object lens for obtaining an image of an object, and animage pickup processing circuit including an image pickup element forconverting the image of the object obtained by the optical system intoan electric signal. When an imaging key arranged on the key operatingsection 219 is manipulated, the optical image of the object is picked upby the optical system.

The image pickup processing circuit converts, into an electric signal,the optical image of the object formed by the optical system.

Specifically, in the image pickup processing circuit, the image of theobject is received by multiple light-receiving elements that arearranged, as pixel sections, on the two-dimensional plane of the imagepickup element. At this time, color information is obtained through thecolor filters of the light-receiving elements, whereby it is separatedinto data for the three primary colors (R, G and B).

The image pickup processing circuit converts the luminance levels of theindividual pixels into voltages, and an analog/digital (A/D) convertersequentially converts the voltages into digital data that it transmitsto the controller 220.

A CCD or a CMOS sensor, for example, is employed as the image pickupelement.

In accordance with an instruction issued by the controller 220, thenotification section (the sounder) 213 generates a shutter sound inaccordance with the shutter sound setup data or the basic shutter sounddata.

The notification section (the sounder) 213 is constituted, for example,by a sounder or a vibrator.

In accordance with an instruction transmitted by the controller 220, thesounder monitoring section (the shutter sound appropriateness checkingfunction) 214 determines whether a shutter sound generated by thesounder (the notification section) 213 has a predetermined volume orhigher and whether the shutter sound is appropriate, and outputs theresults to the controller 220.

In this embodiment, the sounder monitoring section 214 may include amicrophone, and a circuit for performing A/D conversion of soundsreceived through the microphone, for performing A/D conversion of theamplitude of a sound signal that the controller outputs to the sounder213, and for obtaining the results, or for detecting an output volume inaccordance with digital data that the controller 220 outputs to thesounder 13.

Upon receiving the instruction from the controller 220, the soundermonitor 214 monitors the sounder 213 and determines whether anappropriate sound was generated within a specific period of time for thepurpose of “providing notification for a surrounding area of imaging inthat vicinity”.

When the sounder monitoring section 214 determines that an appropriatesound was not generated within a specified period, the soundermonitoring section 214 transmits to a sounder driver 2201 for thecontroller 220 an instruction to generate a shutter sound based on basicshutter sound data.

For this embodiment, the following example is employed by the soundermonitoring section 214 as a “determination reference for releasing anadequate shutter sound”.

When a sound has a frequency in the audible range and is generated, at avolume of 65 dB or higher, for 0.2 seconds or longer within 0.5 secondsof the start of monitoring (imaging), this sound is determined to be“appropriate”.

FIG. 10 is a graph showing an example waveform for a case wherein ashutter sound was generated by the sounder at an adequately high volume.

FIGS. 11A and 11B are graphs showing example waveforms for cases whereina shutter sound was not generated by the sounder at an adequately highvolume.

In the example in FIG. 11A, a sound at 65 dB or higher was not generatedwithin 0.5 seconds of the start of monitoring (imaging). In the examplein FIG. 11B, a sound at 65 dB or higher was generated for less than 0.2seconds within 0.5 seconds of the start of monitoring (imaging).

FIG. 12 is a graph showing an example waveform for a case wherein thesounder monitoring section 214 determined, by referring to thedetermination reference, that an adequate sound was not generated andthereafter issued an instruction to the sounder driver 2201 to generatea shutter sound based on basic shutter sound data, and wherein, inconsequence, a basic shutter sound was generated by the sounder.

In other words, in the example in FIG. 12, since the volume of theshutter sound generated by the sounder was inadequate, a basic shuttersound was generated.

The memory 215, which is accessed by the controller 220, includes ashutter sound setup data storage section 2151 for storing shutter soundsetup data that can be set by an application that sets a shutter soundor in accordance with data for a shutter sound, and a basic shuttersound data storage section 2152 for storing basic shutter sound dataprepared as data for default shutter sound data.

The memory 215 also includes a nonvolatile memory, an EEPROM, in whichimage data obtained and compressed by the image pickup section 212 arestored.

The display section 216 includes a display device, such as a liquidcrystal display device controlled by the controller 220, and displaystelephone numbers, a variety of messages and text data entered toperform a communication function.

The display section 216 also displays the image of an object obtained bythe image pickup section 212.

The sound output section 217 performs predetermined processing for soundinformation received from the controller 220, and outputs sound at aloudspeaker.

The sound input section 218 performs predetermined processing for soundcollected using a microphone, and transmits the obtained soundinformation to the controller 220.

The key operating section 219 includes an end (end communication)/powerkey, a start (call) key, ten key pad, for corresponding numbers, and animaging key, and when these keys are manipulated by a user, informationentered by the user is transmitted to the controller 220.

The controller 220, constituted mainly by a micro computer, controls theentire cellular phone 210 that serves as an image pickup terminal.

The controller 220 provides, for example, control of the radiotransmission/reception of a variety of information by the radiocommunication section 211, of the processing of sound information forthe sound output section 217 and the sound input section 218, of thedisplay of information on the display section 216, of the processingperformed in consonance with information entered at the key operatingsection 219, and of access relative to the memory 215.

The controller 220 may have a function for employing the determinationobtained by the sounder monitoring section 214 (a shutter soundappropriateness checking function) to inhibit the setup of shutter soundsetup data based on an application that sets a shutter sound or data fora shutter sound.

The controller 220 includes a sounder (a shutter sound) driver 2201 forcontrolling the sounder 213, a camera (photography) driver 2202, acamera (photography) application 2203 for issuing an instruction to thecamera driver 2202 and the sounder (the shutter sound) driver 2201, anda forcible shutter sound generation driver for detecting whether thecamera (photography) application 2203 has issued an imaging instructionto the camera driver 2202 and for issuing a shutter sound instruction tothe sounder (the shutter sound) driver 2201.

After the camera application 2203 of the controller 220 issues animaging instruction to the camera driver 2202, the camera driver 2202issues a sounder monitoring instruction to the sounder monitoringsection 214.

Upon receiving the instruction, the sounder monitoring section 214monitors the sounder 213, and determines whether an adequate sound wasgenerated within a specified period for the purpose of “providingnotification for the surrounding area of imaging in that vicinity”.

When the sounder monitoring section 214 determines that an adequatesound was not generated within the specified period, the soundermonitoring section 214 issues an instruction to the sounder driver 2201to generate a shutter sound based on a basic shutter sound data. Uponreceiving this instruction from the sounder monitoring section 214, thecontroller 220 accesses the memory 215 and reads the shutter sound setupdata, or the basic shutter sound data, and outputs that data to thesounder 213.

The operation of the cellular phone 210 in FIG. 9 will now be explainedwhile referring to FIG. 13.

When the imaging key of the key operating section 219 of the cellularphone 210 in FIG. 9 is manipulated (ST21), and when an imaginginstruction is issued, via the camera application 2203 of the controller220, to the camera driver 2202 (ST22), an instruction for monitoring thesounder 213 is issued to the sounder monitoring section 214 by thecamera driver 2202 (ST23). Upon receiving this instruction, the soundermonitoring section 214 monitors, for a specified period of time, soundgenerated by the sounder 213 (ST24).

Further, the camera driver 2202 provides imaging control for the camera(the image pickup section) 212 (ST25).

Also, a shutter sound release instruction is transmitted by the cameraapplication 2203 to the sounder driver 2201 (ST26). Then, shutter soundsetup data is read from the memory 215 (ST27) and, based on the shuttersound setup data, the sounder driver 2201 provides the release controlfor the sounder 213 (ST28).

Following this, the sounder monitoring section 214 determines whetherthe sounder 213 generated, within the predetermined specified time, anadequate sound for providing notification for the surrounding area ofimaging in that vicinity.

When the sounder monitoring section 214 determines that an adequatesound was not generated within the specified period, the soundermonitoring section 214 issues an instruction to the sounder driver 2201to generate a shutter sound based on the basic shutter sound data(ST29). Thus, the basic shutter sound data is read from the memory 215(ST210) and, in accordance with that data, the sounder driver 2201provides the release control for the sounder 213 (ST211).

According to the second embodiment, the cellular phone 210 has thememory 215 for storing shutter sound setup data that an application canset for the setting of a shutter sound, or in accordance with data for ashutter sound, the notification section (the sounder) 213 for generatinga shutter sound based on the shutter sound setup data stored in thememory 215, and the sounder monitoring section 214 for determiningwhether a shutter sound, generated either by the application for settingthe shutter sound or in accordance with the shutter sound data, has apredetermined volume or higher. Therefore, when a determination has beenmade that the shutter sound was not generated in the predeterminedvolume or higher based on the determination of the sounder monitoringsection 214, a shutter sound is forcibly generated in the predeterminedvolume or higher. According to this configuration, when an imaging isperformed, a shutter sound having an adequately high volume can begenerated, so that notification can be provided in an imaging area.

Third Embodiment

FIG. 14 is a diagram showing the configuration of a cellular phone 210Aaccording to a third embodiment of the present invention.

The third embodiment differs from the second embodiment in that anpicked-up image temporary storage section 222 is provided for thetemporary storage of photographed image data obtained by a camera 212.

In this embodiment, after a camera application 2203 for a controller220A issues an imaging instruction to a camera driver 2202, the cameradriver 2202 issues a sounder monitoring instruction to a soundermonitoring section 214A.

Upon receiving this instruction, the sounder monitoring section 214Amonitors a sounder 213, and determines whether, during a specifiedperiod of time, an adequate sound was generated for the purpose of“providing notification for a surrounding area of imaging in thatvicinity”.

Further, photographed image data obtained by the camera 212 is stored inthe photographed image temporary storage section 222 and the reading ofthis data is inhibited.

When a determination is made that the sounder 213 generated an adequatesound within the specified period, the sounder monitoring section 214Acancels the reading disabled state of the photographed image temporarystorage section 222.

When, however, when a determination is made that the sounder 213 did notrelease an adequate sound within the specified period, the soundermonitoring section 214A deletes the photographed image data stored inthe photographed image temporary storage section 222.

FIG. 15 is a diagram for explaining the operation of the cellular phone210A in FIG. 14.

In FIG. 15, the step numbers employed for corresponding processes arethe same as those employed in FIG. 13.

When the imaging key of a key operating section 219 of the cellularphone 210A in FIG. 14 is manipulated (ST21) and an imaging instructionis issued, via a camera application 2203 for the controller 220A, to acamera driver 2202 (ST22), an instruction for monitoring the sounder 213is issued by the camera driver 2202 to the sounder monitoring section214A (ST23). Upon receiving this instruction, the sounder monitoringsection 214A monitors, for a specified period of time, sound generatedby the sounder 213 (ST24).

Further, the camera driver 2202 provides the imaging control for thecamera (image pickup section) 212 (ST25).

Also, a shutter sound releasing instruction is transmitted by the cameraapplication 2203 to the sounder driver 2201 (ST26). Then, shutter soundsetup data is read from the memory 215 (ST27) and, based on the shuttersound setup data, the sounder driver 2201 provides the release controlfor the sounder 213 (ST28).

Furthermore, photographed image data obtained by the camera 212 isstored in the photographed image temporary storage section 222 and thereading of this data is inhibited (ST212).

When a determination made by the sounder monitoring section 214A is thatthe sounder 213 generated an adequate sound within a specified period oftime, the sounder monitoring section 214A cancels the reading disabledstate of the photographed image temporary storage section 222 (ST213).

When, however, a determination made by the sounder monitoring section214A is that the sounder 213 did not release an adequate sound within aspecified period of time, the sounder monitoring section 214A deletesthe photographed image data stored in the photographed image temporarystorage section 222 (ST213).

The photographed image data stored in the photographed image storagesection 222 is read through the camera application 2203 of thecontroller 220A (ST214). It should be noted that data reading isdisabled when reading inhibition is set.

According to the third embodiment, since the photographed image datathat is obtained can not be used when an adequate sound is notgenerated, illegal use of the image data can be prevented.

1. An image pickup terminal, comprising: an image pickup section; a datastorage section which stores shutter sound setup data that sets ashutter sound generating when the image pickup section performs animaging; a shutter sound generating section which generates a shuttersound based on the shutter sound setup data stored in the data storagesection; a shutter sound appropriateness checking section which checkswhether a shutter sound based on the shutter sound setup data stored inthe data storage section is appropriate or not; a storage section whichtemporarily stores image data of an image picked up by the image pickupsection; and a control section which controls the shutter soundgenerating section to generate the shutter sound based on the shuttersound setup data stored in the data storage section when the imagepickup section performs an imaging, wherein the control section inhibitsthe image data stored in the storage section from being read when ashutter sound generated from the shutter sound generating section isinappropriate.
 2. The image pickup terminal according to claim 1,wherein the control section deletes the image data stored in the storagesection when the shutter sound generated from the shutter soundgenerating section is inappropriate.
 3. The image pickup terminalaccording to claim 1, wherein the shutter sound appropriateness checkingsection includes, at the least either a section which detects volume ofa shutter sound generated from the shutter sound generating section withusing a microphone, or a section which detects amplitude of a digitalsignal or an analog signal related to the shutter sound generated fromthe shutter sound generating section.
 4. The image pickup terminalaccording to claim 1, wherein the shutter sound appropriateness checkingsection determines a shutter sound as being appropriate when the shuttersound generates in predetermined volume or higher for a predeterminedperiod of time or more within a specific period of time following theimaging start.